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METHOD OF RECORDING AMD OF REPLAYING AND VIDEO RECORDING AND REPIiAY SYSTEMS 


The invention is related to recording and replaying video information from 
randomly accessible storage devices, such as discs. In particular, the invention is related to 
configurations in which more than one process concurrently has access to a randomly 
accessible disc, e.g. via time slot multiplexing. Such configurations may be present in 
situations where video on demand services are offered. In this case a video replay system 
outputs several concurrent video streams, which are all read from the disc. In some situations 
the same video is even replayed for different users, which started the video at different times. 

It is desired to extend the options of the above described video replay system 
to permit the individual user to switch between different replay modes, as in home video 
recorders.. In normal play mode a video is replayed at a rate, which is in accordance with an 
original recording speed. In a trickplay mode the video is replayed at another rate, e.g. fast 
forward or in reverse. 

In home video recorders trickplay modes like fast forward and reverse are 
implemented by spooling the magnetic tape in the desired direction and with the desired 
speed along the magnetic head and by reading video frames at preselected instants from the 
tape. Video frames that are used during normal replay are also used for trickplay, but 
dedicated video frames for trickplay may be provided as well, near the positions on the tape 
where corresponding normal play frames are recorded. If a user gives a command to switch 
to another replay mode during spooling, the direction and the speed of the magnetic tape are 
adjusted. The video recorder continues to replay the video in the newly selected mode. Thus 
it is possible to switch between different replay modes at arbitrary instants in response to user 
commands. 

From US 6 453 115 a video replay system is known that employs randomly 
accessible memory to store a stream and uses tables with pointers referring to so-called I- 
frames in the video stream in order to support trick play. I-frames represent a part of the 
video information in MPEG coded video data. Trickplay streams are generated by jumping to 
selected I-frames and by reading them in arbitraiy order. However, jumping to different disc 
locations for retrieving the selected I-frames places a severe demand on the access bandwidth 
of the disc, so that the number of processes that may read the disc is relatively small. This is 
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in particular the situation if all these processes run in a trickplay mode, such as fast forward 
or &st reverse. 


S It is an object of the invention to enable switching between different replay 

modes at arbitrary instants during replay of a video stream while reducing the amount of 
access bandwidth of the randomly accessible memory that is required for access. Therefore a 
method of recording a video stream according to the invention comprises tiie steps of 
receiving a video stream; generating fix>m the video stream a normal play stream and a 

10 trickplay stream representing the normal play stream at a trickplay rate by selecting and 
arranging data from the normal play stream; storing normal play stream data and trickplay 
stream data as separately accessible files on at least one randomly accessible storage device; 
and providing linking information, which links the selected data fi-om the normal play stream 
in the trickplay stream with corresponding data in the normal play stream. 

15 By storing a normal play stream and a triclqplay stream as separately 

accessible files, which can each by itself be played in the same way as a normal stream, 
niemory access optimization strategies may be applied to video streams for different trick 
play modes individually, such as storing successive parts of a file in successive tracks and 
sectors. Methods of storing separate files and file storage optimization strategies are well 

20 known per se, for example for computer (PC) hard disks. Such strategies make it possible to 
reduce the access bandwidth demand to access the randomly accessible storage device. By 
providing separate files for different play modes including a normal play mode and one or 
more trickplay modes, trickplay will not lead to a higher bandwidth use. As a result, more 
users can be connected to the video replay system, or more access bandwidth requiring 

25 operations can be performed on the at least one randomly accessible storage device. By 
providing linking information which links trickplay stream data with normal play stream 
data, the system is enabled to switch virtually seamlessly from the normal play mode to the 
trickplay mode, and vice versa. Storing the normal play stream and the triclq)lay stream as 
separately accessible files is also advantageous when the trickplay stream is generated and 

30 stored in semi real time fi'om the normal play stream, i.e. when the generation of the trickplay 
stream takes place in a non-iastantaneous way while the normal play stream is recorded. 

The invention is also related to a method of replaymg a video stream which 
comprises tiie steps of providmg a randomly accessible memory on which normal play 
stream data and trickplay stream data are stored as separately accessible files, the trickplay 
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Stream data representing the normal play stream data at a trickplay rate, being selected and 
arranged from the normal play stream, providing linking information, which links the 
selected data from the normal play stream in the trickplay stream with corresponding data in 
the normal play stream; retrieving one of a plurality of play stream data from the at least one 
S randomly accessible storage device; generating part of a video stream from tihe retrieved play 
stream data; receiving a switch signal during replay of the generated part of the video stream, 
the switch signal representing a new play mode; reading the linking information; determining 
by means of the linking information a first position in the play stream according to the new 
play mode, the position corresponding to a second position in the part of the video stream 

10 that is displayed at the moment on which flie switch signal is received; retrieving new play 
stream data from the at least one randomly accessible storage device according to die new 
play mode, starting with data related to the determined first position; and 
generating a new video stream from the retrieved new play stream data. 

During replay a controller, which is provided on a video replay system, 

15 retrieves a play stream and generates a video stream according to a received signal 

representing a play mode. As an example, if an individual user selects a normal play mode, 
the controller generates a video stream by retrieving normal play stream data from a first file. 
If a user wants to switch to another, new replay mode at an arbitrary instant during replay of 
the video, he or she generates a signal representing the new play mode by communicating via 

20 an interface terminal. The controller receives this signal and retrieves new play stream data 
from a separate, second file, according to the new play mode. This is accomplished by 
starting with new data forming the new stream and corresponding to data at the position in 
tiie generated video stream according to the previously play mode where the switch occurred. 
Correspondence of these data is available, since linking information is provided during the 

25 record of the video stream. Again, as an example, if the user selects a trickplay mode during 
replay of the video, the controller retrieves trickplay stream data, starting from a position in 
the stream that corresponds to the present position in the normal play stream data. Due to the 
provided linking information which links corresponding image representation data, the 
controller is able to perform this operation. Then, the controller generates a new video stream 

30 from the retrieved new play stream data for replay at a replay terminal. 

Thus the invention enables a video system offering video on demand services, 
to replay several videos for different users, and to switch each video stream from normal play 
mode to a trickplay mode and vice versa upon request of an individual user. 
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Other embodiments according to the invention are expressed in the dependent 

claims. 


S The objects and the advantages of the invention will be illustrated using 

exemplary embodiments shown in the drawuig. In the drawing shows: 

Fig. 1 a video recording system according to the invention; 

Fig. 2 a flowchart representing a method of recording a video stream; 

Fig. 3 a video replay system according to the invention; 
10 Fig. 4 a flowchart representing a method of replaying a video stream; 

Fig. 5 a scheme of video stream data according to the invention; 

Fig. 6 a scheme according to Fig. S showing a table with pointers; 

Fig. 7 a scheme of replaying a video using different play modes according to 
tilie invention; and 

15 Fig. 8 a scheme according to Fig. 5 showing pointers in the video stream data. 


In Fig. 1 a video recording system 1 is shown. The system 1 comprises a 
controller 2, which is connected to an input terminal 3, and a randomly accessible storage 
20 device 4, such as a disc. The disc 4 may comprise a magnetic disc, CD, or DVD. The 

controller 2 is also connected to a further memory device 6 comprising a table with linking 
information. 

A flow chart of the recording process is shown in Fig. 2. In use, as a first step 
30 the video recording system 1 receives the video stream data via the input terminal 3. In 

25 one embodiment the video stream is encoded, e.g. by means of an MPEG coding algorithm in 
order to save memory space, or even encrypted to prevent unauthorized access. In a second 
step 31 controller 2 generates a triclq>lay stream data from the received video stream. In a 
third step of the recording method, the controller 2 controls a storage process of data on the 
disc 4. More particularly at least two kinds of video stream data are stored as separately 

30 accessible file on the at least one disc 4, viz. as a file for normal play stream data and another 
file for trickplay stream data. 

The normal play stream data represent the video data for replaying in a normal 
play mode, at a realistic rate, i.e. a rate that is in accordance with an original recording rate. 
The normal stream may be a copy of the received video data, or may be newly generated (for 
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example compressed and/or encrypted) by controller 2. Hie trickplay stream data generated 
by controller 2 represent the same video data as normal play stream data, but so that upon 
normal replay of this tric]q)lay stream a trickplay effect occurs as compared with the normal 
stream, such as fast forward or fast reverse. Controller 2 generates triclcplay stream data by 
S selecting and arranging data from the normal play stream. In this way information from the 
normal play stream is extracted to form the trickplay stream. Preferably controller 2 
compresses and/or encrypts the trickplay stream data before storage. 

During the storing process, as a fourth step 33, the controller 2 writes linking 
data in a table that is stored in the further memory device 6. The table comprises linking 

10 information with respect to the video stream as will be explained below. Although a separate 
further memory device is shown, it will be appreciated that the table may also be stored on 
the same disc 4 as the streams (optionally as a table part, or distributed table parts in one or 
more of the streams), or that copies may be stored at multiple locations. In the fifth step 34, 
the processor checks if more video data is to be recorded. In that case the process continues 

15 with the first step 3Q. Otherwise, the controller awaits for the next video information. 

In Fig. 3 a video replay system 7 is shown. The replay system 7 comprises 
partly the same elements as the video recording system 1 . The controller 2 provided on the 
replay system 7 is connected to the disc 4 and to the further memory device 6. The controller 
2 is further connected to a set of output terminals 8, which are all connectable to both a 

20 replay terminal 9 and an interface terminal 23. Each ou^ut terminal 8 interacts with an 
individual user via the replay terminal 9 and the interface terminal 23. Hence, the video 
replay system 7 is dedicated for video on demand (VOD) services for multiple users. 

« 

Fig. 4 schematically shows a flow chart of the method of replaying video 
streams by means of the video replay system 7. In a first step 35, a user selects a program, 
25 e.g. a film. The user communicates with the controller 2 via the inter&ce temiinal 23 and the 
ou^ut terminal 8. Upon selection of the program replay system 7 automatically selects a 
current play mode, preferably the normal play mode, for replaying the selected program. If 
desired, the user may command selection of another current play mode, e.g. trickplay mode at 
this time. 

30 As a second step 36, the controller 2 retrieves from the disc 4 one or more 

frames from the video file that corresponds to &e selected program in the current play mode. 
When the current play mode is the normal play mode, for example, firames from the file for 
normal play stream data are retrieved. In a third step 37 the controller generates a segment of 
a video stream from the retrieved fi'ames for replay on the replay terminal 9 of the user. In the 
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fourth step 38 the user is enabled to select another play mode. If no selection is carried out, 
the replay process is continued from the same file returning to the second step 36. 

If tihe controller 2 receives a switch signal representing a selection by the user 
of a new play mode via the above described conununication chain 8, 23, the video replay 
5 system 7 will change the current play mode to the newly selected replay mode and start 

replaying the selected program in the new replay mode, e.g. a trickplay mode. Replay system 
7 accomplishes this by retrieving frames for the new play stream data from another file, 
selected according to the new play mode in second step 36 and generating a new, second 
video stream from the retrieved new play stream data in third step 37, and outputting the new 

10 video stream to the output terminal 8. 

In step 39, prior to executing from second step 36 for the newly selected 
replay mode, controller 2 reads the linking information that has been provided during the 
storing process described with reference to Fig. 2. The linking information may be read from 
disc 4 (optionally as a table from one of the streams, or as successive instalments of the table 

15 from an ongoing stream, or from a memory into which the linking information may be copied 
from disc 4, initially when play of the stream is started, or into which the linking information 
has been written during recording. In step 40, the controller 2 determines the position in the 
play stream data file for the newly selected play mode, which corresponds to the position in 
the play stream data file to which display had advanced during replay in the previous play 

20 mode. 

After the controller 2 has determined the position in the play stream data file 
for the new play mode the process continues with the second step 36 and 37, i.e. retrieving 
video data from the newly selected video file, and generating a new video stream starting 
from the position tiiat has been determined. Thus the controller 2 jumps from a first selected 
25 file to a new, second selected file, at a position that contains content that corresponds to the 
content in the original file, following the position to which display had advanced at the time 
of the switch. 

Fig. S illustrates linking information. Fig. 5 schematically shows the normal 
replay stream 10 and two trickplay streams 11, 15. For particular positions in video streams 
30 the table comprises address information concerning data in the play streams that correspond 
to the particular positions. In a particular embodiment according to the invention the table 
may be represented as in table I 
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Table I Linking infonnation 



position 1 

position 2 

position 3 

Stream 1 

address 1 

address! a 

addresslb 

stream 2 

address 2 

address2a 

• 

stream 3 

address 3 

• • • 

• 

999 

999 


• s • 


Hence, during the recording stage, address infonnation of corresponding data 
in at least the normal play stream and at least one trickplay stream is stored in the table 24 as 
5 is indicated in Figure 6 with respect to the normal play stream 10 and one trickplay stream 1 1 
for particular positions in a particular video stream. Hie address infonnation, which is also 

* 

called linking information, may also concern data from a second trickplay stream or from 
even more trickplay streams. The address information specifies addresses in the files for 
different play modes that contain corresponding content from the stream. By means of the 

10 linking information, the controller 2 is enabled to interconnect data in different video play 
streams of one particular video. In other words, conesponding data in different play streams 
10,1 1 are interconnected by means of linking information 12 which is stored in the table 
during the recording process. 

In particular, the address information contained in the table may point to 

13 memory locations in the files where sections of streams have been stored that represent the 
same frame or frames, e.g. an I-frame or groups of pictures (GOPs) in MPEG coded video 
which are represented as file packet numbers. The use of addresses of I-fiames has the 
advantage that the image can immediately be replayed without retrieving data from other 
frames. In essence, the linking information of the table 24 comprise pointers 13, 14 referring 

20 to the sections. 

Instead of pointing directly to memory corresponding locations in files, the 
linking information may also contain information that is sufficient to compute corresponding 
locations. A location of content x may be computed for example using a formula 
L(x)=LO+R*x in case of a fixed compression rate stream. R, the replay rate is known for each 
25 stream. When LO values are provided for each stream conesponding locations can be 

computed. Preferably, a plurality of LO values is provided each for a respective section in the 
stream to permit more accurate computations. This works well for streams that use fixed rate 
compression (for example for part of the streams) but not for streams that use variable rate 
compression. In the latter case more LO values may be provided for different sections of the 
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Stream, together whfa local R values. Even if tiiis does not provide accurate locations, it may 
be used to speed the search for the correct location, using PGR values for example. A similar 
technique may be used to compute corresponding PGR values in different streams. 

The linking information may be stored as a separate table, or as a table part of 

S one or more of the streams. The table for the whole stream need not be provided as a single 
table, but instead successive instalments of the table may be included in the stream, each for 
switching to another mode during a subsequent part of the stream. From the MPEG standard, 
for example, several techniques for including tables in a stream for other purposes are known, 
similar techniques may be used for including tables for switching between trickplay modes 

10 and a normal mode. In this case, instalments of the table are preferably loaded into a working 
memory each time when they are encountered. 

If the video replay system 7 switches from a first play mode to a second play 
mode, the controller 2 searches in the table 24 for a position in the first play stream, also 
called reference point, which is close to a section 26 of the first play stream that represents an 

1 5 image which is replayed just before switching the play mode. 

« 

Hiere are several ways of finding such a reference point in the first play 
stream. In one embodiment the controller 2 selects the reference point in the table 24, which 
corresponds to the address of the most recently replayed section 26 in the video stream before 
the switch. In another embodiment the controller 2 selects the reference point in the table 24 

20 corresponding to the address of the section 26 next to the switch. In yet another embodiment 
the controller 2 selects th^ reference point in the table 24 which corresponds to the address of 
the section 26 which is chronologically most near the moment in the video stream at which 
the switch occurs. When the reference point in the table 24 has been selected, Ae pointer 
13,14 relating to the play stream data 10, 1 1, 15 according to the second play mode, provides 

25 address information for finding the desned section 26 in the stream that represents an ims^e, 
which needs to be retrieved in order to continue the process of generating the video stream 
37. In this way the controller 2 switches from a first replay mode to a second replay mode 
and vice versa. 

Fig. 7 shows again the normal replay stream 10 and one trickplay stream 11. 
30 Further a switching path 22 is schematicdly shown, starting with video data in the normal 
replay stream data 10. In this situation the user has selected a first, normal replay mode. At a 
particular moment the controller 2 retrieves video data from the trickplay stream data 1 1 as a 
response to the user which selects a second, trickplay mode. After some time the user selects 
flie normal mode agam, and the controller continues to generate a new video stream by 
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retrieving video information from the normal playstream data 10. Each time a nearly 
seamless switch is performed through the use of linking information. 

In other embodiments of tiie invention the linking information is implemented 
in the video streams and not in a s^arate table. One embodiment makes use of MPEG PGR 
5 information to realize linking. In MPEG coded video streams, program clock references 

(PCRs) synchronize the replay rate with respect to the recording rate. The nonnal play stream 
and the trickplay stream have different PGR time bases, due to the different replay rate or 
time direction of the video play mode. 

In an embodiment the linking information is stored in the form of information 

1 0 about PGR values of positions with corresponding content in the nonnal stream and the trick 
play stream or streams. The information about such corresponding PGR values may be stored 
m the files for each stream, or only in a subset of the files, for example only in the file that 
contains the stream for nomial play. Such linking information may be provided in the form of 
sets of corresponding PGR values stored at various positions in a video stream for a particular 

15 play mode, the PGR values in each set specifying the PGR values of corresponding content in 
video streams for the same program m different play modes. The corresponding PGR value in 
the stream in which the set is stored may be part of the set, or may be implied by the PGR 
value that corresponds to the position in the stream where the set is stored in the stream. The 
embodiment in which the file for the stream for each play mode contains information about 

20 corresponding PGR values in the streams for other play modes will be illustrated first. 

During a switch from the trickplay mode to the nonnal play mode, while a 
section 43 of the trickplay stream 11 is replayed, the controller 2 determines a reference point 
near the section 43 according to a search algorithm, e.g. as described above. Next, the 
controller 2 determines tiie PGR time value of the reference point in the normal play stream 

25 10, from information about the conesponding PGR value stored in the trickplay stream. Then 
the controller 2 searches in the normal play stream 10 until the conesponding PGR time 
value has been found. The search activities are symbolically illustrated m Fig. 8 by means of 
anows 16, 17. Although a chronological search from the start of the stream is used, it should 
be understood that other types of search may be used, for example a binary search (reading a 

30 PGR from midway the file, determining whether it is above or below the required PGR, 

reading a PGR from midway the section m front of or behind the midway position, dependent 
on whether the required PGR is lower or higher respectively and so on) or an indexed search 
(using a table of locations in the stream for a number of PGR values, finding a location of a 
PGR nearest the required PGR values and searchmg the stream from there). When the PGR 
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time base in the normal play stream has been foimd, the controller 2 starts retrieving normal 
play stream data at a section 44 corresponding to PGR value, to generate a new video stream 
for replay. The switch from the trickplay mode to the normal play mode has been performed. 

An advantage of providing linking information in the video stream rather than 
S in a separate table is that the linking information in the video stream is more dynamic and 
invariant for the sequence of a decoding and a new encoding step. 

A switch from the normal play mode to a trickplay mode is performed in a 
similar way. When a user commands for a switch during replay of a section 41 in the normal 
play stream, the controller 2 determines a reference point near the section 41, finds the 
10 corresponding PGR value in the trick play stream from linking information in the normal 
stream and searches in the trickplay stream for the PGR value, and starts retrievmg trickplay 
stream data at a section 42 corresponding to the reference point. The search activities of the 
controller 2 are symbolically illustrated by means of arrows 18 and 19. 

A switch from a first triclq)lay mode to a second trickplay mode is performed 
15 along the same lines as a switch from a trickplay mode to the normal play mode, provided 
that the controller 2 searches in the second trickplay stream data for the stored PGR time base 
in the normal play stream 10 to find the corresponding section 45 in the second trickplay 
stream data. The search activities of the controller 2 are symbolically illustrated by means of 
arrows 20 and 21. 

20 In another embodiment, linking information that specifies corresponding PGR 

values of different streams may be stored in a selected streams only, for example in the 

< 

normal play stream. In this case a switch to the new play stream from another stream at a 
specific PGR value in that other stream involves a search in the normal play stream for a 
location where the specific PGR value for the other stream is stored, retrieval of the 

25 corresponding PGR value for the new stream (this may implicit in the location where Ae 
specific PGR value is stored if the switch is to the normal stream) and replay from the new 
stream, starting from the new PGR value. When the linking information about corresponding 
PGR values is stored in a trick play stream only a similar procedure hold mutatis mutandis. 
The use of a fast play stream for this purpose may be advantageous in this case if the speed of 

30 the search for the corresponding PGR value is important. 

The above described embodiments are particularly suited for applications 
using MPEG coded video streams. The embodiments permit constant bit rate (GBR) as well 
as variable bit rate (VBR) coding schemes. 
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In yet another embodiment according to the invention it is assumed that CBR 
encoding schemes have been applied to the video streams. Hie linking information that is 
stored during the record stage contains the total length of each of the normal play stream and 
of one or more trickplay streams. During a switch from a normal play mode to a trickplay 

S mode the controller 2 computes from the relative position in the normal play stream, the 

relative position in the trickplay stream, using the linking information, e.g. as a fraction of the 
total length. Then the controller 2 continues with retrieving data and generating the new play 
stream. Switching from a trickplay mode to the normal play mode or to anotiier trickplay 
mode occurs also by means of computing relative positions in the play streams. 

10 In another embodiment the controller 2 computes a relative time position in a 

normal play stream using the total time period of the stream which has been stored during a 
recording process as linking information, and the current PGR time base corresponding with 
a section which is currently replayed. For performing a switch from the normal play mode to 
a triclqplay mode, tiie controller 2 determines from the relative time positions a relative file 

15 position in the trickplay stream, assimiing the trickplay stream is coded with CBR schemes. 
This method is suited for application when the normal play stream is coded using VBR 
algorithms. 

In yet another embodiment the controller 2 computes a relative file position in 
a trickplay stream from which new video data is to be retrieved, by using the total time period 
20 of the normal play stream being currently replayed, the total time period of the trickplay 
stream, and the current PGR time base corresponding with a section which is currently 
replayed. If a stored normal play stream PGR time base in the determined relative file 
position in the new play stream does not match with the section in the normal play stream, 
the controller 2 preferably performs a new iteration step, e.g. by linearization using the 
25 packet numbers in the normal play stream and trickplay stream, respectively, and the stored 
normal play stream PGR time base in the trickplay stream. 

The invention is not restricted to the described embodiments. Many alternative 
video systems replaying video streams by means of linking information are possible. 

It is noted that the sections of streams that represent images do not necessary 
30 contain GOPs or I-frames. Also P-frames or B-frames are possible. 

Further, the invention is not restricted to one disc 4. The video recording 
system and/or the video replay system may comprise two or more discs on which normal 
play stream data files and trickplay stream data files are stored. In a preferred embodiment, 
normal play stream data and trickplay stream data are stored on different discs in order to 
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reduce access bandwidlli of the discs and/or reduce the switching time. Thus activities 
relating to both the normal play stream and the trickplay stream can be executed more or less 
simultaneously. 

In another embodiment the video streams (the normal stream and the trickplay 
5 streams) may be recorded in encrypted form or encrypted during replay, to prevent illegal use 
of video data. In this case, the linking information is preferably provided so that it can be 
accessed without decrypting the stream. This makes it possible to switch quickly between 
encrypted streams for normal and trick mode replay. The controller generates a trickplay 
stream from the normal play stream which is either compressed or imcompressed. 
10 Further, it is advantageous to construct trickplay streams using I-frames or 

GOPs from the normal play stream, since the replay of I-frames and GOPs do not need 
information of other frames in the stream. This is in particular the case if the normal play 
stream is compressed. The above-mentioned approach saves decompression time for the 
controller. 

15 In an embodiment according to the invention a reverse trickplay stream is 

generated. This is accomplished by generating the reverse trickplay stream from a forward 
trickplay stream. In a preferred embodiment the reverse trickplay stream is generated off-line 
when the entire normal play stream has been stored on disc. This approach saves bandwidth 
of the storage device and adjustments of timing information in the stream. When the reverse 

20 trickplay stream is generated, linking information is also generated and stored, for use during 
replay. 

These embodiments are assumed to be obvious for the man skilled in the art 
and are considered to fall within the scope of the following claims. 


